Quasi two-dimensional antiferromagnet on a triangular lattice RbFe(Mo04)2 
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RbFe(Mo04)2 is a rare example of a nearly two-dimensional Heisenberg antiferromagnet on a 
triangular lattice. Magnetic resonance spectra and magnetization curves reveal that the system has a 
layered spin structure with six magnetic sublattices. The sublattices within a layer are arranged in a 
triangular manner with the magnetization vectors 120° apart. The H — T phase diagram, containing 
at least five different magnetic phases is constructed. In zero field, RbFe(Mo04)2 undergoes a phase 
transition at Tjv = 3.8 K into a non-coUinear triangular spin structure with all the spins confined in 
the basal plane. The application of an in-plane magnetic field induces a collinear spin state between 
the fields i/ci=47 kOe and _H'c2=71 kOe and produces a magnetization plateau at one-third of the 
saturation moment. Both the ESR and the magnetization measurements also clearly indicate an 
additional first-order phase transition in a field of 35 kOe. The exact nature of this phase transition 
is uncertain. 

PACS numbers: 76.50-|-g; 75.50.Ee; 75.30.Cr 



I. INTRODUCTION 

The problem of an antiferromagnet on a triangu- 
lar planar lajl±i£up_LAFMT) has been intensively studied 
theoretically.Ejol3'ElEl The ground state in the Heisenberg 
and XY-models is a "triangular" planar spin structure 
with the three magnetic sublattices arranged 120° apart. 
The orientation of the spin plane is not fixed in the ex- 
change approximation. 

A non-zero magnetization appears in the presence of a 
magnetic field due to the canting of the sublattices. Pos- 
sible field- induced structures are shown on Fig. 1. All 
configurations with equal magnetization vectors but with 
different sublattice orientations havg the same energy 
in the molecular field approximation.U The umbrella-like 
structure "a" with the sublattices tilted from the spin 
plane towards the field, and the planar structures "b" 
and "b"' are among these degenerate configurations. In 
this approximation the b-configuration becomes collinear 
(c-configuration) at a particular field He = i?sat/3, where 
Hgat is the saturation field. In magnetic fields above 
He, the structure is again noncoUinear, with two paral- 
lel sublattices tilted with respect to the third, forming 
the "canted" d-phase. Finally, at the saturation field 
H — Hsat, a spin-flip transition to the phase "f occurs. 

Because of the degeneracy of the classical spin configu- 
rations, both quantum and thermal fluctuations play an 
important rolcJiipthc formation of the equilibrium state 
of the AFMT.ElEfQ They result in a free-energy gain of 
the planar structure with respect to the umbrella-like 
structure. Due to the contribution of fluctuations to 
the free energy the more symmetric configuration "b" 
is preferred to "b'". Further, the fluctuations stabilize 



the collinear spin conflguration "c" in a range of mag- 
netic fields Hci < H < Hc2 around the special point 
H = ^Hsat- Thus, a magnetization plateau should be 
observed over a relatively wide field range. 

In the case of an easy-plane magnetic anisotropy, an 
analogous evolution of the sublattice orientations is ex- 
pected when a magnetic field is applied in the easy plane. 
The umbrella-like structure should be realized for mag- 
netic fields applied along the six- fold axis C^, provided 
the easy-plane anisotropy is sufficiently strong. 

The magnetic resonance spectrum of a 120°-spin struc- 
ture differs from the spectrum of a usual antiferromag- 
net both in the number of normal modes and in the 
dependencies of frequencies on the applied magnetic 
field. There are three eigenmodes for a 2D triangular 
structured For the case of an easy-plane anisotropy, two 
of them are degenerate in zero field, but have nonzero fre- 
quency; the third mode has zero-frequency in zero field. 
In a magnetic field there are three different resonance 
frequencies of uniform spin precession. 

The presence of the interplanar antiferromagnetic ex- 
change requires one to consider at least a six-sublattice 
3D magnetic structures. For a weak interplanar exchange 
however, the main features of the 2D-system should re- 
main unchanged. The interplane exchange may cause 
additional field-induced phase transitions, where the mu- 
tual orientation of spins in neighboring planes changes. 
Possible magnetic structures of the 3D XY AFMT in a 
magnetic field were analyzed in Ref. 0, while the Heisen- 
berg AFMT was considered in Ref. 07 A two-fold period 
along the C'^ (or C^) axis is assumed here. The structures 
under consideration are shown schematically in Fig. 1 
and denoted as Bl, B2, B3, C, Dl and D2. For the 
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FIG. 1: Schematic representation of the proposed spin struc- 
tures of a Heisenberg antiferromagnet on a triangular lattice. 
Structures a, b, b', c, d and f are related to the 2D sys- 
tem (J' = 0). Structures BO, Bl, B2, B3, C and D represent 
the triangular antiferromagnet with a weak antifern-omagnetic 
interlayer exchange in the six-sublattice modehu solid and 
dashed arrows with the same numbers correspond to mag- 
netic moments of neighboring spins from neighboring layers. 



zero-field starting structure, BO, the nearest neighbor- 
ing spins, which are placed one above another along the 
C^-axis, are considered to be antiparallel due to the an- 
tiferromagnetic interplane exchange. Depending on the 
relative values of the in-plane magnetic field, interplane 
and intraplane exchange integrals, a phase from the set 
shown on Fig. 1 should be realized. Thus, for a particular 
combination of both exchange fields, one might expect a 
sequence of phase transitions in an increasing magnetic 
field. Particularly, a sequence of transitions like B1-B3- 
C-Dl-D2-f is possible according to Ref. ^ The last phase 
corresponds to the parallel orientation of the magnetiza- 
tion of all six sublattices in a high magnetic field. Nat- 
urally, the interplanar interaction may also modify the 
values of the critical fields Hd and Hc2 with respect to 
the purely 2D caseH 

As far as the magnetic resonance spectrum is con- 
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FIG. 2: Temperature dependence of the magnetic suscep- 
tibility of RbFe(Mo04)2 for two directions of the magnetic 
field. 



cerned, the interplanar exchange should result in a split- 
ting of the main eigenfrequencies and in the appearance 
of new modes due to the increased number of sublattices. 

There are several materials with triangular lattices car- 
rying magnetic ions, however, the members of the family 
AFe(T04)2 (A=Cs, Rb; T=S, Mo) with RbFe(Mo04)2 
among them, are the most likely candidates for AFMT- 
systems suitable for experiments. Other related com- 
pounds, e.g. the ABXa-family (A^^Cs, Rb; B=Ni, Mn, 
Cu; X=C1, Br, I), have an interplanar exchange that is 
larger than the intraplanar one, thus they are quasi-lD 
magnets (see, e.g., Ref. P,p^ . "Triangular" antiferromag- 
nets from other families, VX2 (X=C1, Br, I) (Ref. y) 
and ACr02 with A=Li, Cu (Ref. have quasi-2D 

exchange, but their exchange field is too large, shifting 
the field-induced transitions outside the range of conven- 
tional measurements. A review of the magnetic proper- 
ties of the triangular magnets is given in Ref. 

In the present paper, we describe a study of the mag- 
netic and resonant properties of RbFe(Mo04)2, a ma- 
terial which can be considered as a rare example of a 
nearly two-dimensional Heisenberg antiferromagnet on 
a triangular lattice and that can be prepared in single- 
crystal form. At room temperature the crystal structure 
of RbFe(Mo04)2 has the space group P3to1. The mag- 
netic Fe^+ ions with spin S ~ 5/2 are placed on the 
hexagonal lattice with lattice parameters a =5.69 A and 
c =7.48 A. The Mo04-tetrahedra are placed between the 
layers of Fe"^+-ions and form the structure with the three- 
fold axis. The exchange integral J representing the in- 
teraction within the planes should be much larger than 
the exchange integral, J', of the nearest neighbor ions in 
adjacent planes. The large difference in these exchange 
integrals is due to the different exchange paths of the in- 
direct exchange interactions: via two oxygen ions within 
the planes and via three or even more oxygen ions be- 
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FIG. 3: Field dependence of magnetization of RbFe(Mo04)2 
for H II C^ r= 1.6 K. 

tween the planes. Thus, the structure of RbFe(Mo04)2 
may be considered (see, e.g., Ref. |l^) as an ensemble of 
layers with a triangular lattice occupied by S" = 5/2 Fe'^+ 
ions, and these magnetic layers are separated by layers 
of Mo04-Rb-Mo04. Magnetic ions in neighboring layers 
are placed one above another. 

Evidence for a structural transformation at T=180 K 
was recently reported in Ref. Small changes of lat- 
tice constants, Raman spectra and ESR linewidth indi- 
cate a structural transformation, identified as a second- 
order phase transition from a highly symmetric P3ml 
room-temperature structure into a very similar but less 
symmetric P3cl low-temperature structure. This trans- 
formation corresponds to rotations of the M0O4 tetra- 
hedra. The "triangular" spin structure of Fe'^^-layers 
in crystals of RbFe(Mo04)2 was recently confirmed by 
the elasticj-aeutron scattering experiment in zero mag- 
netic field.t£l At the same time, according to the observed 
neutron diffraction, an incommensurate modulation of 
the ordered spin structure in the C'^-direction is present 
there: the mutual orientation of spins from neighbor- 
ing planes is close to the antiparallel one but is slightly 
tilted at an angle of 17°. The low-temperature magne- 
tization curves (^jjowder samples of RbFe(Mo04)2 were 
reported earlier. The magnetization saturated at a field 
of Hsat = 186 kOe and a magnetization plateau marking 
the collinear phase was observed. 

Neutron scattering experiments of Ref. |l^ confirm- 
ing the triangular magnetic structure were performed for 
powder samples of the related compounds CsFe(S04)2 
and RbFe(S04)2. 

We have verified experimentally the theoretical con- 
cepts outlined above by taking advantage of single-crystal 
samples of RbFe(Mo04)2. The choice of a molybdate in- 
stead of a sulphate allowed us to avoid the hydration 
and to obtain single crystals. Field-induced phase tran- 
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FIG. 4: Field dependence of the magnetization (top panel) 
and its derivative (bottom panel) of RbFe(Mo04)2 for H _L 
C^, T = 1.6 K. The inset shows the hysteresis region around 
the transition field Hc3- 



sitions and low frequency spin dynamics in the different 
phases were studied by means of magnetization measure- 
ments and ESR spectroscopy. In the present paper we 
describe several field-induced phase transitions including 
transitions not detected earlier. Each phase is found to 
possess a characteristic set of spin-resonance modes. 



II. SAMPLES AND EXPERIMENTAL 
TECHNIQUES 

Single-crystal samples of RbFe(Mo04)2 were synthe- 
sized by means of the spontaneous crystallization from 
a fiux melt. The mixture of RbFe(Mo04)2 and of 
K2M02O7 in the molar ratio of 1:2 was heated in a plat- 
inum crucible up to a temperature of 1300 K and held 
at this temperature for 12 hours then cooled to 1000 K 
at a rate of 3 K/h. The nucleation of crystals was lo- 
calized due to the temperature gradient near a platinum 
rod which was inserted into the melt in the precristal- 
lization state. The platinum rod was withdrawn from 
the solution after the crystallization. The K2M02O7 flux 
was removed by dissolving in water. A much slower di- 
lution of the crystals of RbFe(Mo04)2 takes place at the 
same time. The crystals have the shape of thin hexago- 
nal plates with the size of 3-4 mm along each edge. The 
lattice parameters ace in accordance with those reported 
for powder samples.lij The magnetization curves and the 
temperature dependencies of the magnetic susceptibility 
were measured using a vibrating sample magnetometer 
with the field range - 120 kOe. Magnetic resonance 
spectra were taken by a set of transmission-type mag- 
netic resonance spectrometers with resonators covering 
the range 9-120 GHz. 
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FIG. 5: Temperature dependencies of the magnetization of 
RbFe(Mo04)2 in fixed magnetic fields. The arrows mark the 
temperatures of the abrupt changes of the magnetization cor- 
responding to the magnetic phase boundaries. 



III. EXPERIMENTAL RESULTS 
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FIG. 6: The H magnetic phase diagram of RbFe(Mo04)2 
derived from the single crystal magnetization and ESR mea- 
surements. Data marked by triangles are taken from pow- 
der measurementstj, open circles correspond to magnetiza- 
tion measurements, filled squares - to ESR-data. The two 
vertical line segments near T = illustrate the field ranges 
of the phase "c" according to calculations from Ref. ^ for the 
Heisenberg and the XY-model. The two shadowed ovals mark 
the regions of smeared changes in the magnetization slope for 
T > Tn. 



A. Susceptibility and magnetization curves 

The temperature dependence of the susceptibility of 
RbFe(Mo04)2 at low temperatures is shown in Fig. 2 and 
clearly demonstrates the transition into the magnetically 
ordered state at Tn = 3.8 K. The susceptibility mea- 
surements in the whole range 10-300 K reveal the tem- 
perature dependence of the Curie- Weiss type {T + Qc)~^ 
with the value of the Weiss constant 0c = 22 ± 2 K. A 
small (about 0.1%) step- like anomaly in the reverse sus- 
ceptibility appears at 180 K giving an additional indica- 
tion for the structural transformation mentioned in the 
Introduction. There is a significant deviation from the 
Curie- Weiss behavior below 10 K. A strong anisotropy of 
the susceptibility also appears in this temperature range, 
well above T/v. 

Below the transition point T/v = 3.8 K, the magneti- 
zation curves M{H) are quite different for different ori- 
entations of the magnetic field. For H \\ C^, the mag- 
netization increases linearly with the field for all values 
of the applied field (see Fig. 3). For H ± C^, the field 
dependence of the magnetization is much more compli- 
cated, as shown in Fig. 4 for T = 1.6 K. There are abrupt 
changes in the slope of the magnetization curve at 47 kOe 
and 71 kOe, with the differential magnetic susceptibility 
being significantly reduced in the region between these 
fields. 

An additional, first-order phase transformation with 
a hysteresis in M{H) curve was detected at Hc^ — 35 



kOe. Magnetization measured between 30 and 38 kOe 
shows a large difference in signal obtained for the rising 
and falling magnetic field. A smaller, but still clearly 
observable difference exists down to a field of 20 kOe. 
In order to detect the transitions by changing temper- 
ature we measured the temperature dependence of the 
magnetic moment at constant magnetic field. Several 
examples of these data are shown in Fig. 5. The temper- 
atures of the abrupt changes of the magnetization curves 
are marked by arrows and indicate the field dependence 
of the Neel temperature and the temperature dependence 
of the fields Hd and iJc3- The values of critical magnetic 
fields and temperatures derived from the curves like those 
shown in Figs. 4 and 5 are collected on the H — T phase 
diagram in Fig. 6. There are at least 4 ordered antifer- 
romagnetic phases PI, P2, P3, P4 and a paramagnetic 
phase PM. 

It should be noted that smeared changes in the mag- 
netization slope were observed at the critical fields Hd 
and Hc2 for temperatures slightly above the Neel temper- 
ature. These regions are marked in Fig. 6 by shadowed 
ovals. 



B. Antiferromagnetic resonance 

On cooling the samples, the ESR line broadens 
markedly below 10 K. After passing through the Neel 
point, the ESR line shifts from the paramagnetic reso- 
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FIG. 7: Temperature evolution of the 36.6 GHz ESR line in 
RbFe(Mo04)2 at cooling through the critical region and Neel 
point. 
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FIG. 8: Magnetic resonance lines in RbFe(Mo04)2 at different 
frequencies at ii" || C^ T = 1.3 K. 



nance position and again becomes rather narrow. The 
temperature evolution of the ESR line is shown in Fig. 7. 
In this paper we discuss only the low-temperature mag- 
netic resonance, well below the Neel point. The critical 
behavior will be the subject of further investigations. 

The field-dependencies of the microwave transmission 
at T = 1.3 K are shown in Fig. 8 and Fig. 9 for two ori- 
entations of the magnetic field. We can derive the field 
dependencies of the spin-resonance modes in the ordered 
state from the positions of the resonance-absorption lines 
at different frequencies. As shown in Fig. 9, the mi- 
crowave absorption data are sensitive to all the phase 
transitions detected in the magnetization measurements. 
The hysteresis loop around the field Hcs is clearly ev- 
ident in the microwave absorption. The change of the 
microwave absorption at this transition is frequency- 
dependent. The curves taken at a frequency around 25 
GHz are the most sensitive to this transition as they 
demonstrate the largest hysteresis around Hcs- 

For H II C^, two branches of the resonance are clearly 
seen. The frequency of the first branch rises with the 
field, while the frequency of the second branch decreases 
(see Figs. 8 and 10). The frequencies of these two 
branches are monotonic functions of the applied mag- 
netic field as expected for the umbrella-like structure. 

For H J- C^, a complicated nonmonotonic dependence 
of the resonant frequencies i>i with varying magnetic field 
was observed (see Fig. 11). The frequency- field curves 
contain abrupt changes at the fields of the phase tran- 
sitions in accordance with the data of the magnetiza- 
tion measurements. The values of the phase-transition 
fields derived from the microwave-absorption curves are 
marked on the phase diagram in Fig. 6 by filled squares 
and are in a good agreement with the results of static 
magnetization measurements. The total number of the 



observed spin resonance modes is five. 



IV. DISCUSSION 

A. Basic principles 

The observation of the sequence of the phase tran- 
sitions for the magnetic field lying in the basal plane 
implies that there is an easy-plane type of anisotropy 
(an easy-axis anisotropy would result in the umbrella- 
like spin structure at _ff _L without the cascade of 
field-induced phase transitions). 

At the moment there is no explanation for the nature 
of the incommensurate modulation observed in Ref. 
but on the assumption of the small deviation from the an- 
tiparallel orientation of spins in neighboring planes, we 
shall describe the field-dependent spin structure in the 
approximation of the perfect antiferromagnetic orienta- 
tion of spins in neighboring layers in the zero-field ground 
state. 

Thus, we consider the following model spin- 
Hamiltonian, following the notation of Ref. |^. 

+ 2 J' 

{ij),n in 

+DJ2{SLf-9^^BHJ2S^n■ (1) 
in in 

Here the sums are taken within the layers {i, j) and along 
the transverse direction (n), and D > is the constant 
of the anisotropy of the easy-plane type. 
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FIG. 9: Magnetic resonance lines in RbFe(Mo04)2 at different 
frequencies ati^_LC^,^ = 1.3K. 



B. Field-induced phase transitions and molecular 
fields 

Using the molecular-field calculation^ of the suscepti- 
bilities along and perpendicular to the C^-axis 



XII 

x± 



\SJ + 2D' 

\2 



18J 



(iV is the number of magnetic ions) , we can estimate the 
strength of the exchange field, He, and the anisotropy 
field, Ha: 



Hf. 



6JS 



= 67 kOe, 



9^J■B 

D S* 

Ha (5± 1.5) kOe. 

The value of He is in a good agreement with the satura- 
tion field value Hsat— 186 kOe measured in Ref. |l^ (ac- 
cording to the molecular- field calculations Hgat = SHe). 

The nearly vanishing slope in the M(if)-curve in the 
field range between Hd and i?c2 indicates the presence of 
magnetization plateau and suggests that we should treat 
this phase as the collinear phase (phase C of Fig. 1), 
which is stabilized in the range,|Hni < H < Hc2 by ther- 
mal and quantum fluctuations.l3lj'Ll Using the J value de- 
rived from the susceptibility measurements and the ratio 
J' /J derived from the magnetic resonance spectra (see 
the next section) we can propose a sequence of phase 
transition on the basis of the model of Ref. ||, where 
the calculated phase diagram at T = is plotted on 
the H/ J, J' S/ J - plane. At the consideration of that 



phase diagram one should remember that our situation of 
the easy-plane anisotropy should be considered neglect- 
ing the umbrella-like phase derived for the isotropic ap- 
proximation. For our case of J'S/J = 0.095 with an 
easy plane anisotropy this phase diagram predicts a se- 
quence of phase transitions B1-B2-C-D1-D2 in the mag- 
netic field. Thus, according to the theoretical analysis 
of Ref. H, we can propose that in the field Hc3 we have 
transition like B1-B2 with change in the mutual orienta- 
tion of spins in neighboring layers, then transition B2-C 
aX H = Hci and C-Dl at H = Hc2- Thus we propose 
the observed sequence P1-P2-P3-P4 may be treated as 
B1-B2-C-D1. 

It should be noticed that the phase boundary observed 
in the temperature range 3.4-4.2 K and in fields above 
Hc2 cannot be smoothly extrapolated to the saturation 
field 186 kOe at r=1.3 K. Therefore, the existence of yet 
another phase transition at higher magnetic field cannot 
be ruled out. According to the analysis given in Ref. ||, 
the phase D2 is energetically favourable for certain val- 
ues of the interplanar exchange in a field just below the 
saturation field. Thus we suggest the region of the phase 
diagram indicated in Fig. 6 as P5 may be treated as the 
D2 phase. 

Using only the results of magnetization and ESR mea- 
surements we cannot distinguish between the phases Bl, 
B2, B3 and between the Dl and D2 phases. Thus, an 
alternative sequence of phase transitions, such as B2-B3- 
C-Dl (Ref. |l^) should, in principle, also be considered as 
an explanation of the observed sequence P1-P2-P3-P4. 
A scenario for the field-induced transitions with B2 as 
the starting phase is also suggested on the basis of the 
molecular field approximation in Ref. ^ The tiny dif- 
ferences between the free energies of the phases Bl and 
B2 may be associated with the contribution of thermal 
and quantum fluctuations which should be taken into ac- 
count along with the anisotropy. In any case, the exact 
solution of this problem will only have a limited signifi- 
cance for RbFe(Mo04)2 because of the incommensurate 
modulation mentioned, which is still not included in the 
theoretical models. 

Nevertheless, the observation of the i7c3-phase transi- 
tion clearly marks the effect of the interplanar exchange 
on the field-dependent phases of the AFMT with weakly 
coupled layers. 

The observed boundaries in the coUinear phase range 
may be compared to the calculationaa performed using 
an isotropic {D = 0) and XY (infinite D) models at 
T ~ K. The calculated zero-temperature field-ranges 
of the C-phase (using He — 67 kOe) are shown in the 
phase diagram in Fig. 6 by the line segments. There is a 
qualitative agreement with our observations. 



C. Spin-resonance modes 

For a triangular system with antiferromagnetic inter- 
plane exchange interactions, there should be five reso- 
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FIG. 10: ESR frequency of RbFe(Mo04)2 vs. magnetic field 

for H II C^ T = 1.3 K. The curves are calculated dependen- pj^ ^gj^ frequency of RbFe(Mo04)2 vs. magnetic field 
cies after (11, 12), parameters are described in the text. H ± C\ T = 1.3 K. Dashed curves represent the calcula- 

tion after (8, 9, 19, 20), solid curves - after (13, 18). 



nance modes with non-zero frequencies (the frequency 
of the sixth mode is zero in smah fields in absence of 
any in-plane anisotropy). We have observed all five res- 
onances for H J- C^. For weak magnetic fields, where 
the exchange triangular spin configuration is only slightly 
distorted, the resonance frequencies may be calculated 
following the macroscopic theory based on a classical La- 
grange formalismQ. This method of calculation is suitable 
for complicated and multi-sublattice systems, however it 
is valid only in the field range where the exchange mag- 
neticj-structure is not strongly distorted by the magnetic 
field.Ej The basic principles of the calculations and the 
resulting formulae are given in Appendix A, while the 
field-dependencies of the resonant frequencies are pre- 
sented in Fig. 10, and Fig. 11 (the values of the param- 
eters will be described below). For the modes i^^^q in 
the low-field range, the oscillating components lie within 
the plane. The modes with frequencies 1^1,2.3 correspond 
to the in-phase oscillations of spins in the neighboring 
planes while for the modes with frequencies 1^4,5,61 the 
spins in the neighboring planes oscillate out of phase. 
Note that for a purely 2D AFMT only the modes J^i,2,3 
are present. 

The frequencies calculated in this way are only valid 
for small magnetic fields, when the exchange triangular 
structure is not strongly distorted. Thus the approx- 
imation used is not strictly true in fields of the order 
of Hci- The distortion of the triangular structure, as 
shown in the 2D approximatiorJj, will result in a field 
dependence of the resonance frequencies vi, v^. The ap- 
proximate correspondence between the parameters of the 
macroscopic theory described in Appendix A and of the 
spin-Hamiltonian may be derived using estimates (i.e. 
neglecting zero-point fluctuations) for the susceptibility 
and resonance frequencies derived for 2D AFMT in the 



molecular-field approximation: 

= ISJDS^ = -/^SHaHe, (2) 
= 7^ff|;y, (3) 

here 7 = 5/15/271 ?i. 

The nonzero frequency of the mode i^e confirms the 
interplanar exchange. Another indication of the inter- 
planar exchange is the splitting of the rising ESR mode 
(the difference in resonance fields of the modes V2 and 1^5 
in Fig. 11). 

The five spin resonance branches shown in the low- field 
range in Fig. 11 and the resonance frequencies for H || 
(Fig. 10) may be reasonably described by the equations 
(8-12) with only two fitting parameters: a=90.8 GHz and 
c=32 GHz. The dashed curves in Fig. 11 and curves in 
Fig. 10 are calculated in this way with the anisotropy 
parameter of the susceptibility, rj = 0.05, derived from 
the susceptibility measurements. 

Using the value of the susceptibility described above 
and the molecular-field relations (|^, |^) we can evaluate 
the molecular fields and parameters of the Hamiltonian: 
He = 67 kOe, Ha = 5.2 kOe, J'/J 0.039. These 
values of He and Ha are in reasonable agreement with 
the values derived from the susceptibility and saturation 
field. 

For H _L C^, the triangular spin structure of 
RbFe(Mo04)2 is already strongly distorted in a field of 
about 10 kOe. Therefore the macroscopic theory of mag- 
netic dynamics given in Ref. cannot be used. To have 
at least an approximate description of the resonant fre- 
quencies over wider range of applied fields, we used the 
calculations for the three-sublattice 2D model (i.e. for 
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J' =0) in a classical approximation.u The results of these 
calculations (relations 13, 18) are presented in Fig. 11 by 
the solid lines. The values of D and J used to calculate 
these curves are taken from the values of He and Ha 
given above and thus agree with the parameters used for 
fitting the data in low fields according to relations (8-12). 

For qualitative description of the resonance frequencies 
within the field range of the coUinear phase Hd < H < 
Hc2, one should take into account the zero-point fluctua- 
tions stabilizing this phase in that field range. The appro- 
priate calculation was made in the J' — Q approximation 
with the assumptions of the,XY-modcl in the same paper 
of Chubukov and Golosov.H Corresponding relations for 
the lowest resonance frequencies are given in Appendix 
B (relations 19,20) and are plotted by dashed lines in the 
region Hd < H < Hc2 in Fig. 11. These formulae reveal 
critical softening of the resonance frequencies near the 
fields Hci and Hc2- We observe a soft mode near Hc2 
which is in qualitative agreement with relation (po[). 

V. CONCLUSION 

A sequence of field-induced phase transitions, governed 
by the intraplane exchange interaction and by the weak 
interplane exchange was found in RbFe(Mo04)2, a quasi- 
2D antiferromagnet on a triangular lattice. The mag- 
netic properties may, in part, be explained in terms of a 
2D antiferromagnet on a triangular lattice. However, a 
phase transition governed by weak interplane exchange 
was found. This phase transition is accompanied by the 
changes in spin-resonance spectra. A self-consistent de- 
scription of the magnetization curves, phase transitions 
and resonance modes in a wide field range is given. 
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VI. APPENDIX A. SPIN RESONANSE MODES 
IN THE MACROSCOPIC APPROACH 

We consider 120°-triangular structures in planes 1 and 
2, which can be represented by normalized spin densities 

Si (r) = 111 cos qr -t- 112 sin qr , 

S2(r) = I21 cosqr -I- 122 sinqr. ^' 



Here In, I12 and I21, 122 are two pairs of orthogonal unit 
vectors of antiferromagnetism, = 47r/3a, gj, = 0, a - 
crystal period within the plane; vector r takes discrete 
values within the basal plane pointing at the magnetic 
sites on a triangular lattice. This structure is due to the 
in-plane exchange. The mutual orientation of spin trian- 
gles in neighboring planes for weak interplane exchange 
corresponds to the minimum of the Heisenberg exchange 
energy of nearest neighbors from different planes: 

a(liil2i + I12I22) (5) 

For a > 0: In = -I21, I12 = -l22- 
For a < 0: In = I21, I12 = l22- 

Note, that the low-frequency spectrum, which depends 
on the quadratic expansion on the angles of the mutual 
rotation of the spin triangles, is the same for the antifer- 
romagnetic {a > 0) and ferromagnetic {a < 0) exchange. 

The Lagrange function of the spin dynamics has three 
contributions: two "ordinary" terms of the triangular 
structures of the two systems of spin planes (In, I12) 

1 1 ^(Jli + jUf + ^^(J^i + 7H, ni)^ + /3nL} 

(6) 

and (121,122) 

1 I ^(^2 + + ^^^(J^2 + 7H, + PnlJj 

. ^ . ^ . 

while the third term, the energy of the interplane ex- 
change, is given above (^). Here ni = [I11I12], n2 = 
[I21I22] are unit vectors in the spin space, which are nor- 
mal to the spin planes, /? - is the constant of uniaxial 
anisotropy, fli and fl2 - are angular velocities of rotation 
of the spin triangles. The values x\\ and x±~ determine 
the components of the tensor of the magnetic susceptibil- 
ity in the ground state, along and perpendicular to the 
vector rii respectively. 

For the in-plane field, the frequencies of the in-phase 
oscillations of spins in neighboring planes are given by: 

vi — a, 

V2 - V^TlP, (8) 
z/3 = 

The additional frequencies due to the interplane ex- 
change (spins of different planes oscillate " out of phase" ) 
are 

2^6 + + H'^± (9) 

V(62 + C2 + i/2)2 _ 4c2(52 _ ^^2) 

Here A' = j'a/x±, = l'P/x±, V = = 
2^2/(1 + rj). Parameters a, b and c are coupled by the 
relation 

2(6^ - a^) = (1 + ?7)c2 (10) 
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For the magnetic field oriented parallel to the C^-axis, 
ordinary resonances (in-phase motion of triangles) are: 



1^3 = 0, 

while the additional frequencies (the triangles rotate in 
opposite directions) are: 



ve = c 



(12) 



VII. APPENDIX B. SPIN-RESSNANCE MODES 
IN 2D MODELEI 



1. Molecular field approximation 



Introducing the normalized field 



US 



SH/H„ 



we have the following resonance frequencies, for the mag- 
netic field lying in the easy plane of 2D-AFMT: 
1) below the transition to the coUinear phase {0 < h < 1) 



6JS 
2^ 



(13) 



V2 
^3 



6JS 
2Trh 




^{3 + 2h + h^) 



(14) 
(15) 



2) above the transition to the canted phase (1 < /i < 3) 



1/1=0 

6JS 



V2 



2-11% 

6JS 
2^ 



D [h^ - ih^ + 35/i2 + 63) 



6J 16/i2 \ 

D {9~h^){h^ -l)ih^ + 7) 



6J 



16/i2 



(16) 
(17) 

(18) 



2. XY-model including fluctuations 

The two lowest resonant frequencies in the collinear 
phase are 



6JS f hc2 — h 



1^3 



2-Kh 



(19) 
(20) 



Here hci and hc2 are the normalised values of the critical 
fields Hci and Hc2- 
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